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• DTM/DSM generation from HRSI 
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• High-resolution PAN & MS imagery 

+ Quickbird (0.7 m) 

+ IKONOS (1.0 m) 

+ SPOT (2.5-10 m) 

+ ALOS/ PRISM (2.5 m) 

• More than 8-bit images, higher dynamic range 

• Along- / cross-track stereo; 

Possibly multiple view terrain coverage 


• Challenge: 

+ Algorithmic redesign 
+ Improvements 
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More than 8-bit images, higher dynamic range 
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• Along- / cross-track stereo; 

Possibly multiple view terrain coverage 
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SAT-PP ( Sat ellite Image Precision Processing) -- High-Res Satellite Imagery (HRSI): < 5 m 
+ New Processing Methods / Products for HRSI 

+ Joint Sensor Model for IKONOS, QuickBird, SPOT, ALOS/RPISM and etc. 

+ Specially Designed Image Matching Procedure for Linear Array Imagery 


r 


Input 

Imagery with 

Supplementary 

Data 

+ IKONOS 
+ QuickBird 

+ SPOT 

GCPs 



SAT-PP 

+ Image Orientation 

+ Image Matching 

+ Feature Collection 

+ 3D City Modeling 

+ Image Pan-Sharpening 

+ DTM & Ortho-Image 
Generation 



Products 

+ DSM / DTM 
+ Ortho-Images 
+ Pan-Sharpened 
Images 

+ 3D Vector Data 
+ Digital Image Maps 
+ 3D City Models 
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Functionality of SAT-PP 

Project and data management tools, image format conversion and 
pre-processing, image display / roaming in mono and stereo modes 

S Sensor models (RFM, affine and projective DLT model) 

Orientation of single stereo models 

S On-line quality control and error analysis via interaction of graphics 
elements 

GCP and tie point measurement in manual and semi-automated 
modes 


Derivation of quasi-epipolar images for stereo mapping and 
feature collection 

S Automated DSMs generation 

Generation of ortho rectified images 

S Mono-plotting functions with DTMs 

Manual and semi-automatic object extraction in mono/stereo 

S 3D city modeling by using CyberCity Modeler™ 

S Pansharpening image generation. Fully automated sub-pixel 
image registration between multispectral and panchromatic imagery 
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Workflow of SAT-PP 



Given / Estimated 
RPCs 

1 


Image Pre-processing 


Triangulation (Tie Point Measurement & Block Adjustment) 


I 


Guasi-Epipolar Image 
Generation 


T. 


Image Matching 

I 


DSM / DTM Generation 
& Editing 


Orthophoto 

Generation 


Object Measurement 
(Manual f Semi-automatic; 
Mono-Plotting / Stereoscopic) 


CC- Modeler 
(Construct 3D Models & 
Te xture Mapping) 


3D Database 
□TMs, Orthophatos, 
Vector Data. etc. „ 
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• Rigorous sensor model 

+ Physical imaging geometry (nearly parallel projection in along-track and perspective projection in cross- 
track); high accuracy; easier for statistic analysis 
- Mathematically more complicated; depends on type of sensors 

• Sensor model based on RFM 

+ Given (for IKONOS, Quickbird) and computed RFM parameters (RPCs) 


_ f,(X n ,Y„,Z„) 
f 2 (X n J n ,Z n ) 
_ MX n ,Y„,Z n ) 
f 4 (X„J n ,Z„) 


• Blockadjustment model (Grodecki & Dial; 2003) 

+ Calibrated system with a very narrow FOV; accurate a priori exterior orientation data (HRSI - OK !) 


x + Ax = x + a 0 + a^x + a 2 y - RPC x (<p, X, h) 
y + Ay = y + b 0 +b l x+b 2 y = RPC y (<p,A,h) 

• Other simpler sensor models 
+ 3D affine; relief-corrected 2D affine; DLT 
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Sensormodel based on RFM 
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IKONOS Stereo Image Processing Tool (Version 1.0.0) ETH-IGP Hoenggerberg; August 2003 


File Pre-processing Extraction & Measuremnet Viewing Help 
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I - Display Points' ID 
<• Planimetric C Height 


Adjustment Parameters: 
f- Shift Parameters Only 

(Suitable for IKONOS strips less than 50 KM) 

^ Full set of Parameters (6 parameters) 

(Suitable for IKONOS strips longer than 50 KM) 

C 3D Affine T ransformation (without RPCs) 

C Direct Linear T ransform (without RPCs) 
Adjustment Results: 


Blunders Detected: 

NO BLUNDERS HAS BEEN DETECT” 

Parameters for the Left Image: 
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Ellipse fitting method GCP measurement 



INTRODUCTION 


SENSOR MODELING 


DSM GENERATION 


CASE STUDIES 


CITY MODELING 


CONCLUSIONS 


12 







Eidgenossische Technische Hochschule Zurich 
Swiss Federal Institute of Technology Zurich 


Photogrammetry 


pf 

* Femi 


Remote Sensing 


Detailed DSM Generation 


The approach uses a coarse-to-fine hierarchical solution with an effective 
combination of several image matching algorithms and automatic quality control. 

The new characteristics provided by the IKONOS and Quickbird imaging 
systems, i.e. the multiple-view terrain coverage and the high quality image data, 
are also efficiently utilized. 

It was originally developed for multi-image processing of the very high-resolution 
TLS/Starlmager aerial Linear Array images. Now it has been extended and has 
the ability to process other linear array images as well. 
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Workflow of Automated DSM Generation 
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Automated DSM Generation Procedure 

• Multiple image matching 

+ Matching guided from object space 
+ Simultaneously multiple images (>= 2) with 
Geometrically Constrained Cross-Correlation 

• Matching with multiple primitives — points + edges 

• Self-tuning matching parameters 

• High matching redundancy 

• Efficient surface modeling 

+ TIN (from a constrained Delauney triangulation method) 

• Coarse-to-fine Hierarchical strategy 
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Matching guided from object space 



Strip-1 : Backward Image 


Strip-1 : Forward Image 


The Reference Image 


Strip-2: Forward Image 


Strip-2: Nadir Image 


Strip-2: Backward Image 


Strip-3: Forward Image Strip-3: Nadir Image Strip-3: Backward Image 
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Self-tuning matching parameters 




Strip-2: Forward Image 


Strip-2: Nadir Image 


Strip-2: Backward Image 


Strip-1: Forward Image 


The Reference Image 


Strip-1: Backward Image 
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IKO NOS Trip let, 
Hobart, Austra lia 


RPC + 2 Translates 

GCPs(CPs) RMSE-X RMSE-Y RMSE-Z 


0 ( 124 ) 

2.75 

2.00 

1.97 

1 ( 123 ) 
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Automatic DTM/DSM Generation (IKONOS, Hobart, Australia) 


Remote Sensing 



+ The strip encompassed buildings and suburban housing 
in central and southern Hobart; accuracy 0.25 m 
+ 111 GCPs as reference: 


RMSE-Z: 0.9 m; Mean: -0.3 m; Absolute max.: 2.9 m 


+ LIDAR DSM as reference (ca. 252000 points): 

RMSE-Z: 2.7 m; Mean: -0.2 m; Absolute max.: 29.6 m 


Raster DSM (5 m Spacing) 
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SP015-HRS, 
Bavaria, Germany 
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SP015-HRS, 
Bavaria, Germany 
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Automatic DTM/DSM Generation (SPOT5-HRS, Bavaria, Germany) 

Study area: Bavaria, Germany 

+ Area: 120 x 60 Km 2 
+ Height range: ca. 1600 m 
SPOT HRS stereo pair 
+ Acquisition time: 1st October, 2002 
+ 5m / 10m res. In along-/cross-track 
Reference data: 

+ 81 GPS GCPs (only 41 used) 

+ 6 reference DTMs 


DIM Name 

Location 

DTM Spacing (m) 

Source 

DTM Size 

Height Accuracy (m) 

DTM-1 

Prien 

5x5 

Laser Scanner 

5km x 5km 

0.5 

DTM-2 

Gars 

5x5 

Laser Scanner 

5km x 5km 

0.5 

DTM-3 

Peterskirchen 

5x5 

Laser Scanner 

5km x 5km 

0.5 

DTM-4 

Taching 

5x5 

Laser Scanner 

5km x 5km 

0.5 

DTM-5-1 

Inze 11-North 

25 x 25 

Laser Scanner 

1 Okm x 1 . 3km 

0.5 

DTM-5-2 

Inzell-Sourth 

25 x 25 

Contour lines 

10km x 7.7km 

5.0 

DTM-6 

Vilsbibur^ 

50 x 50 

Photo gr amm etry 

50km x 30km 

2.0 
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Remote Sensing 


Automatic DTM/DSM Generation (SPOT5-HRS, Bavaria, Germany) 



Raster DSM (25 m Spacing, 120 x 60 km 2 ) 
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Remote Sensing 


Automatic DTM/DSM Generation (SPOT5-HRS, Bavaria, Germany) 



Reference DSM (5 m) 


SPOT5 DSM (25 m) 
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Remote Sensing 


Automatic DTM/DSM Generation (SPOT5-HRS, Bavaria, Germany) 



Reference DSM (25 m) SPOT5 DSM (25 m) 
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Automatic DTM/DSM Generation (SPOT5-HRS, Bavaria, Germany) 


DSM Accuracy (All Reference Data) 


Ref. DIM 

Terrain Characteristic 

No. of Points 

Max. Diff. 

Min. Diff. 

Average (m) 

RMSE (m) 

Matched 

Reference 

DTM-1 

Smooth, weakly inclined 

35443 

1000000 

25.1 

-32.9 

-2.6 

5.7 

DTM-2 

Smooth, weakly inclined 

32932 

1000000 

29.1 

-37.1 

-1.2 

5.0 

DTM-3 

Smooth, weakly inclined 

33450 

1000000 

20.7 

-17.2 

-0.5 

3.2 

DTM-4 

Smooth, weakly inclined 

32067 

1000000 

13.6 

-23.1 

-2.5 

4.7 

DTM-5-1 

Rough, strongly inclined 

10327 

21200 

19.2 

-33.5 

-5.8 

8.3 

DTM-5-2 

Rolling, strongly inclined 

71795 

139200 

136.8 

-89.3 

-4.3 

9.5 

DTM-6 

Rough, weakly inclined 

130558 

600000 

26.8 

-27.1 

1.5 

4.0 


DSM Accuracy (Without Trees) 


Ref. DIM 

Terrain Characteristic 

Max. Diff. 

Min. Diff. 

Average (m) 

RMSE (m) 

DTM-1 

Smooth, weakly inclined 

15.4 

-23.7 

-1.7 

4.6 

DTM-2 

Smooth, weakly inclined 

29.1 

-31.7 

0.2 

3.6 

DTM-3 

Smooth, weakly inclined 

20.7 

-13.6 

0.1 

2.9 

DTM-4 

Smooth, weakly inclined 

10.5 

-18.4 

-1.2 

3.2 

DTM-5-1 

Rough, strongly inclined 

19.1 

-13.3 

-1.7 

4.9 

DTM-5-2 

Rolling, strongly inclined 

49.8 

-66.8 

-1.3 

6.7 

DTM-6 

Rough, weakly inclined 

26.3 

-25.9 

2.1 

4.4 
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IKO NOS Images, Thun, Switzerland 


Sub-pixel accuracy in planimetry; ca. pixel accuracy in height 


Comparison of sensor models for the IKONOS stereo pair. CPs are check points. 

MRPC1: RPCs+2 translations; MRPC2: RPCs+6 affine parameters; M 3DAFF: 3D affine transformation 


Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M EPC1 

22 

- 

0.49 

0.57 

0.93 

1.02 

0.97 

2.03 

M_RPC2 

22 

- 

0.43 

0.57 

0.83 

1.01 

0.96 

1.82 

M_3DAFF 

22 

- 

0.62 

0.56 

0.70 

1.36 

0.96 

1.36 

M_RPC1 

18 

4 

0.50 

0.57 

0.93 

1.04 

0.96 

1.94 

M_RPC2 

18 

4 

0.48 

0.57 

0.84 

1.01 

1.09 

2.00 

M RPC1 

12 

10 

0.50 

0.57 

0.93 

1.13 

0.92 

2.10 

M_EPC2 

12 

10 

0.50 

0.57 

0.84 

1.12 

0.96 

1.74 

M_RPC1 

5 

17 

0.50 

0.58 

0.93 

1.02 

0.96 

2.00 

M_RPC2 

5 

17 

0.48 

0.57 

0.83 

1.00 

0.96 

1.82 


I 


Comparison of sensor n 

lodels and number of GCPs for the IKO] 

'JOS triplet. CP are checkpoints. 

Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] 

max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M_EPC1 

22 

- 

0.32 

0.78 

0.55 

0.73 

1.50 

0.78 

M_RPC2 

22 

- 

0.32 

0.78 

0.55 

0.95 

1.53 

0.78 

M_3DAFF 

22 

- 

0.35 

0.41 

0.67 

0.82 

0.91 

0.80 

M_RPC2 

18 

4 

0.33 

0.79 

0.56 

0.80 

1.43 

1.41 

M_RPC2 

12 

10 

0.32 

0.82 

0.60 

0.73 

1.64 

1.04 

M_RPC2 

5 

17 

0.44 

0.92 

0.65 

1.04 

1.83 

1.15 




Comparison between M 

RPC1 and M RPC2 using all five image 

s with different numbers of GCPs. 

Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] 

max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M_KPC1 

39 

- 

0.45 

0.50 

0.93 

1.06 

0.96 

2.07 

M_RPC2 

39 

- 

0.40 

0.49 

0.79 

0.92 

0.86 

1.82 

M_RPC1 

5 

34 

0.45 

0.50 

0.94 

1.10 

0.95 

1.84 

M_RPC2 

5 

34 

0.42 

0.67 

1.07 

1.18 

1.41 

2.25 
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IKO NOS Images, Thun, Switzerland 


Decreasing number of GCPs doesn’t decreasing the accuracy significantly 


Comparison of sensor models for the |IKONOS stereo pair| CPs are check points. 

MRPC1: RPCs+2 translations; MRPC2: RPCs+6 affine parameters; M 3DAFF: 3D affine transformation 
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Comparison of sensor models and number of GCPs for the |lKONOS triplet.! CP are check points. 


Sensor Model 

GCPs 

CPs 
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z-RMSE [m] 

max. Ax [m] 
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0.78 

0.55 
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0.91 

0.80 

M_RPC2 

18 

4 

0.33 

0.79 
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Comparison between M RPC1 and M RPC2 using lall five imagesl with different numbers of GCPs. 


Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] 

max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M_KPC1 

39 

- 

0.45 
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0.93 

1.06 

0.96 

2.07 

M_RPC2 

39 
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0.40 
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0.79 
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Remote Sensing 


Even M_3DAFF could achieve similar results (for IKONOS imagery) 


Comparison of sensor models for the IKONOS stereo pair. CPs are check points. 

MRPC1: RPCs+2 translations; MRPC2: RPCs+6 affine parameters; M 3DAFF: 3D affine transformation 


Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] 

max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M EPC1 

22 

- 

0.49 

0.57 

0.93 

1.02 

0.97 

2.03 

M_RPC2 

22 

- 

0.43 

0.57 

0.83 

1.01 

0.96 

1.82 

M_3DAFF 

22 

- 

0.62 

0.56 

0.70 

1.36 

0.96 

1.36 

M_RPC1 

18 
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0.57 

0.93 

1.04 

0.96 

1.94 
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2.00 

M_RPC2 
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17 

0.48 

0.57 

0.83 

1.00 

0.96 

1.82 


Comparison of sensor models and number of GCPs for the IKONOS triplet. CP are check points. 


Sensor Model 

GCPs 

CPs 

x-RMSE [m] 

y-RMSE [m] 

z-RMSE [m] 

max. Ax [m] 

max. Ay [m] 

max. Az [m] 

M_RPC1 

22 

- 

0.32 

0.78 

0.55 

0.73 

1.50 

0.78 

M_RPC2 

22 
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0.78 

0.55 

0.95 

1.53 

0.78 
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0.35 
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0.80 

M_RPC2 
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0.79 

0.56 

0.80 

1.43 

1.41 

M_RPC2 
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0.82 

0.60 

0.73 

1.64 

1.04 

M_RPC2 
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17 
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1.04 
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1.15 


Comparison between M RPC1 and M RPC2 using all five images with different numbers of GCPs. 
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Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 


Study area: town of Thun, Switzerland 
+ Area: 17 x 20 Km 2 


+ Height Range: 1600 m 
IKONOS Geo Product 


IKONOS 

Image 

Acquisition 

Date 

Scanning 

mode 

Sensor- 
Azimuth [°] 

Sensor- 
Elevation [°] 

Thun_49_000 

2003-Dec-ll 

Reverse 

140.35 

62.78 

Thun 49 100 

2003-Dec-ll 

Reverse 

66.41 

63.56 

Thun_51_000 

2003-Dec-25 

Reverse 

130.39 

62.95 

Thun_51_100 

2003-Dec-25 

Reverse 

72.206 

82.15 

Thun_54_000 

2003-Dec-25 

Forward 

128.17 

82.62 


Reference 


+ 2m spacing LIDAR DSM as reference 
accuracy: 0.5 m (la) for open areas; 

1 .5 m for vegetation & build-up areas 
+ 50 GPS GCPs (only 39 used) 
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Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 



Raster DSM (5 m Spacing) Generated from IKONOS Images 
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Remote Sensing 


Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 
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Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 
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Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 
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Automatic DTM/DSM Generation (IKONOS, Thun, Switzerland) 


Z_diff = LIDAR_DSM_Z - lnterpolation(IKONOS_DSM) 


DSM accuracy evaluation results (triplet part of test area). 
O-Open areas; C-City areas; T-Tree areas; A-Alpine areas. 


Area 

No. of compared points 

Mean (m) 

RMSE (m) 

< 2.0 m 

2 .0-5.0 m 

> 5.0 m 

O+C+T+A 

29,210,494 

-1.21 

4.80 

60.7% 

16.8% 

21.3% 

O+C+A 

17,610,588 

-1.11 

2.91 

77.0% 

13.9% 

10.1% 

O+A 

14,891,390 

-1.24 

2.77 

79.8% 

12.2% 

8.0% 

O 

11,795,795 

-1.00 

1.28 

90.3% 

8.5% 

1.2% 


DSM accuracy evaluation results (stereo part of test area). 


Area 

No. of compared points 

Mean (m) 

RMSE (m) 

< 2.0 m 

2 .0-5.0 m 

> 5.0 m 

O+C+T 

20,336,024 

0.45 

4.78 

57.7% 

21.3% 

20.9% 

O+C 

13,496,226 

-0.33 

3.38 

68.7% 

20.8% 

10.3% 

O 

3,969,734 

-0.97 

1.54 

83.0% 

15.0% 

2.0% 


Z_diff = Matched_POINT_Z - lnterpolation(LIDAR_DSM) 

(dense LIDAR points --> Less surface modeling errors) 

+ Point number: ca. 14,327,000 
+ RMSE: 3.30 m 
Mean: -0.32 m 
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Semi-automated Feature Extraction with SAT-PP 


- Currently available for some kind of objects, such as points, lines and polygons 

- The user only needs to measure, for example, the outlines of buildings in one 
image. The correspondences of building outlines in other images are computed 
automatically. 

- User intervention is possible for editing the polygon/line nodes when mismatching 
occurs 



An extracted building from an IKONOS stereopair. The left building is 
measured manually and the right one is matched automatically. 


INTRODUCTION 


SENSOR MODELING 

DSM GENERATION 

CASE STUDIES 

CITY MODELING 

CONCLUSIONS 


41 



ETH 

Eidgenossische Technische Hochschule Zurich 
Swiss Federal Institute of Technology Zurich 


CyberCity Modelerappnoach, 

from stereo images and laser data 


PhQtogratvmetry 



Remote Sensing 






Eidgenossische Technische Hochschule Zurich 
Swiss Federal Institute of Technology Zurich 


Point Cloud Coding System 

• Independence regarding 
used DPS 

• Reduction of manual labour 






Roof texturing 


Facade texturing 
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TEXTURING 


Generic 

Texturing 



• Texture library 

• Not realistic 

• Regional texture types 

• Automatic 



Automatic 

Texturing 


• (Oblique-) Aerial Imagery 

• Realistic 

• Automatic 


Terrestrial 

Texturing 



• Digital Photographs 

• Realistic / High resolution 

• Manually applied 
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Input & Data Pre-processing 

IKONOS Melbourne Stereopair 

7x7 km area 

elevation range of less than 100 m 

32 GPS-surveyed ground measured semi-automatically by ellipse-fitting method 



Left stereo 

Right stereo 

Date, time (local) 

16/7/2000, 

09:53 

16/7/2000, 

09:53 

Sensor azimuth (°) 

136.7 

71.9 

Sensor elevation (°) 

61.4 

60.7 

Sun azimuth (°) 

38.2 

38.3 

Sun elevation (°) 

21.1 

21.0 


orientation was based on the supplied RPCs parameters (from Space Imaging) 

plus additional 6 affine transformation parameters in image space. 

the RMSEs of orientation are 0.4 meters in planimetry and 0.9 meters in height. 
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, SAT-PP: High Resolution Satellite Imagery Precise Processing (Stereo) ETH-IGP Hoenggerberg; August 2003 


File Pre-processing Extraction & Measuremnet Viewing Help 


-ini * 


□ • I aHEBEfiSSEI I I 

k$ 




| © ! 
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Measurement area overview 
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Generated 3D city model 
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3D City Modeling from Quickbird 

• Quickbird stereo images over Phoenix, USA 

- Acquired on 9 April 2004 

- Along track stereo images 

- GSD: 75cm (mean) 

- Viewing angles: 29°, - 27° 
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Facade textures from library 
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SAT-PP: sophisticated image pre-processing algorithms, a set of sensor models, an 
image matching approach for DSM generation and feature extraction from HRSI. 

Sensor modeling and block adjustment: 

Basically three types of sensor-model orientation concepts at our disposal: 

a) rigorous/physical sensor model 

b) Rational Functional Model (RFM) with given RPCs 

c) 2D affine model, possibly with added parameters 

d) 3D affine and DLT models 

Precise (sub-pixel) GCP / tie point collection (LSM) in semi-automatic model 
Sub-pixel orientation accuracy can be achieved for all models 
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Automatic DSM/DTM generation: 

Reproduces not only general features, but also detailed features of the 
terrain relief 

Height accuracy of around 1 pixel in cooperative terrain 
RMSE values of 1 .3-1 .5 m (1 .0-2.0 pixels) for IKONOS 
RMSE values of 2. 9-4. 6 m (0.5-1 .0 pixels) for SPOT5 HRS 

3D city modeling: 

The manual and semi-automatic feature extraction capability of SAT-PP 
provides a good basis also for 3D city modeling applications with 
CyberCity-Modeler™ (CCM). 

The tools of SAT-PP allowed the stereo-measurements of points 
on the roofs in order to generate a 3D city model with CCM. Additional 
features of CCM allow roof and facade texturing. 

The results show that building models with main roof structures can be 
successfully extracted by HRSI. As expected, with Quickbird more 
details are visible. 
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